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(54) IMAGE PROCESSOR AND IMAGE PROCESSING METHOD 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an image processor that can obtain an 
output image signal with high quality and less deterioration whose resolution is 
converted independently of it that a picture is a still picture or a moving picture 
from an input image signal. 

SOLUTION: The image processor is provided with a frame memory that stores 
an Image signal of an image with the same resolution as that of an output image 
and a 1st resolution conversion section 1 1 that stores an input image signal to 
the frame memory while referring to a motion between an image of the Image 



signal stored in the frame memory and the image by the input image signal to 
correct the pixel position so as to produce the output image signal with high 
resolution to the frame memory, with a 2nd resolution conversion section 12 that 
classifies a feature of a target pixel in the image of the input image signal and 
generates pixels in the image with high resolution corresponding to the target 
pixel through the image conversion arithmetic processing preset corresponding 
to the classified class so as to generate the output image signal with high 
resolution and with an output selection section 13 that selects the image signal 
from the 1st resolution conversion section or the image signal from the 2nd 
resolution conversion section which is proper and outputs the selected image 
signal. 
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CLAIMS 



[Claim(s)] 

[Claim 1] In the Image processing system which acquires the output picture 
signal which forms the image of high resolution rather than the image by this 
input picture signal from an input picture signal The Image by the picture signal 
which is equipped with the frame memory which memorizes the picture signal of 
the image of the same resolution as the resolution of the image of said output 
picture signal, and is memorized by said frame memory, Said input picture signal 
by making it accumulate in said frame memory, amending a pixel location with 
reference to the motion between the images by said input picture signal The 1st 
resolution transducer which generates the picture signal of said high resolution to 
said frame memory, The description about the attention pixel In the Image by the 
input picture signal The attention pixel, Carry out a class classification according 
to the description about two or more pixels containing the time and spatial 
perimeter pixel, and by image transformation data processing beforehand set up 
corresponding to the classified class By generating two or more pixels In the 
image of said high resolution corresponding to said attention pixel The picture 
signal from the 2nd resolution transducer which generates the output picture 
signal of said high resolution, and said 1st resolution transducer, The image 
processing system characterized by having the output selection section which 
chooses one picture signal of the picture signals from said 2nd resolution 
transducer as said output picture signal. 

[Claim 2] Said output selection section is an Image processing system according 
to claim 1 characterized by having the judgment section which judges the motion 
and activity of an image by the picture signal from said 1st and 2nd resolution 
transducers per pixel of a predetermined number, respectively, and the selection 
section which chooses the picture signal from said 1st resolution transducer, or 



the picture signal from said 2nd resolution transducer per pixel of a 
predetermined number according to the judgment result of said judgment section. 
[Claim 3] said judgment section - every pixel of said predetermined number - 
the difference of the picture signal from said 1st resolution transducer, and the 
picture signal from said 2nd resolution transducer - the difference which 
computes a value - with the value calculation section said difference - the 
comparison result of the absolute value of a value, and the threshold set up 
beforehand - being based - said difference, when the absolute value of a value 
is said more than threshold the decision value which the amount of [ of said 
predetermined number ] picture element part moves, and shows that it is a part - 
outputting ~ said difference - the image processing system according to claim 2 
characterized by having the comparator which outputs the decision value which 
shows that the amount of [ of said predetennined number ] picture element part 
is a stationary part when the absolute value of a value is smaller than said 
threshold. 

[Claim 4] Said judgment section is an image processing system according to 
claim 2 characterized by having the selection-signal generation section which 
supplies the signal for choosing the picture signal from said 2nd resolution 
transducer, and making it output to said selection section when judged with the 
amount of [ of said predetermined number ] picture element part moving by the 
static/dynamic detection portion which judges **** for every pixel of said 
predetermined number, and said static/dynamic detection portion, and it being a 
part. 

[Claim 5] The static/dynamic detection portion with which said judgment section 
judges **** for every pixel of said predetermined number. The activity judging 
section which judges whether the activity of which image of the picture signal 
from said 1st resolution transducer and the picture signal from said 2nd 
resolution transducer is more high, When judged with the amount of [ of said 
predetermined number ] picture element part being a stationary part with said 
static/dynamic detection portion It is based on the judgment result in said activity 



judging section. The picture signal from said 1st resolution transducer, The 
image processing system according to claim 2 characterized by having the 
selection-signal generation section which supplies the signal for the activity of 
said image of the picture signals from said 2nd resolution transducer choosing 
the higher one, and making it output to said selection section. 
[Claim 6] Said activity judging section is an image processing system according 
to claim 5 characterized by judging the height of activity by computing the 
dynamic range of the pixel value of two or more pixels which can be set in a 
predetermined field, respectively, and comparing both dynamic ranges about the 
picture signal from said 1st resolution transducer, and the picture signal from said 
2nd resolution transducer. 

[Claim 7] The image by the picture signal with which said 1st resolution 
transducer is memorized by said frame memory, The motion detecting element 
which detects the motion between the images by said input picture signal. The 
image processing system according to claim 1 characterized by for the motion 
detected by said motion detecting element amending a pixel location, and having 
the image storage processing section which adds and accumulates said input 
picture signal in the picture signal memorized by said frame memory. 
[Claim 8] The attention pixel in the image according [ said 2nd resolution 
transducer ] to said input picture signal. The class tap extract section which 
extracts two or more pixels containing the time and spatial perimeter pixel of the 
attention pixel as a class tap, The class classification section which carries out a 
class classification according to the description of said class tap extracted in said 
class tap extract section, Based on the class classified according to said class 
classification section, image transformation data processing corresponding to the 
class concerned is defined. By the defined data processing The image 
processing system according to claim 1 characterized by having the data- 
processing section which generates the picture signal of said high resolution by 
generating two or more pixels in the image of said high resolution corresponding 
to said attention pixel. 



[Claim 9] Said class classification section is an image processing system 
according to claim 8 characterized by carrying out the class classification of the 
description of said class tap with the pattern of the pixel value of two or more of 
said pixels as said class tap. 

[Claim 10] The image processing system according to claim 8 characterized by 
generating two or more pixels in the image of said high resolution corresponding 
to said attention pixel by perfonning an operation with the operation multiplier 
about two or more pixels of the field beforehand appointed about said input 
picture signal corresponding to said class tap, and said two or more pixels 
beforehand set up according to the class classified in said class classification 
section in said data-processing section. 

[Claim 1 1] The process which extracts two or more pixels corresponding to said 
attention pixel from a teacher signal with said operation multiplier homogeneous 
as said output picture signal used in said data-processing section, The process 
which extracts two or more pixels containing said attention pixel and Its time and 
spatial perimeter pixel from a student signal homogeneous as said input picture 
signal as a class tap, The process which carries out the class classification of the 
description about said attention pixel based on the description of said class tap, 
Corresponding to said class by which the class classification was carried out. by 
the operation with two or more pixels of the location corresponding to said 
attention pixel extracted from said student signal as a prediction tap The image 
processing system according to claim 8 characterized by computing as said 
prediction coefficient according to the process which derives the prediction 
coefficient for generating an output signal homogeneous as two or more pixels 
corresponding to said attention pixel extracted from said teacher signal from said 
student signal. 

[Claim 12] In the image-processing approach of acquiring the output picture 
signal which forms the image of high resolution rather than the image by this 
input picture signal from an input picture signal The image of the same resolution 
as the resolution of the Image of said output picture signal by the picture signal 



memorized by the frame memory. Said input picture signai by mal<ing it 
accumulate In said frame memory, amending a pixel location witli reference to 
the motion between the images by said input picture signal The 1st resolution 
conversion process which generates the picture signal of said high resolution to 
said frame memory, To the 1st [ said ] resolution conversion process and 
juxtaposition, the description about the attention pixel in the image by the input 
picture signal The attention pixel. Carry out a class classification according to the 
description about two or more pixels containing the time and spatial perimeter 
pixel, and by image transformation data processing beforehand set up 
corresponding to the classified class The picture signal generated at the 2nd 
resolution conversion process which generates the picture signal of said high 
resolution, and said 1st resolution conversion process. The image-processing 
approach characterized by having the output selection process which chooses 
one picture signal of the picture signals generated at said 2nd resolution 
conversion process as said output picture signal, and outputs it. 
[Claim 13] The judgment process which judges a motion and activity of an image 
according [ said output selection process ] to the picture signal from said 1st and 
2nd resolution transducers per pixel of a predetermined number, respectively. 
The Image-processing approach according to claim 12 characterized by having 
the selection process which chooses the picture signal generated at said 1st 
resolution conversion process, or the picture signal generated at said 2nd 
resolution conversion process per pixel of a predetermined number according to 
the judgment result In said judgment process. 

[Claim 14] the difference of the picture signal with which said judgment process 
was generated at said 1st resolution conversion process for every pixel of said 
predetermined number, and the picture signal generated at said 2nd resolution 
conversion process -- the difference which computes a value - with a value 
calculation process said difference - the comparison result of the absolute value 
of a value, and the threshold set up beforehand - being based - said difference, 
when the absolute value of a value is said more than threshold the decision value 



which the amount of [ of said predetermined number ] picture element part 
moves, and shows that it is a part - outputting - said difference, when the 
absolute value of a value is smaller than said threshold The image-processing 
approach according to claim 13 characterized by having the comparison process 
which outputs the decision value which shows that the amount of [ of said 
predetermined number ] picture element part is a stationary part. 
[Claim 15] Said judgment process is the image-processing approach according to 
claim 13 characterized by having the selection-signal generation process which 
supplies the static/dynamic detection process which judges **** for every pixel of 
said predetermined number, and the signal for choosing the picture signal from 
said 2nd resolution transducer to said selection section when judged with the 
amount of [ of said predetermined number ] picture element part moving by said 
static/dynamic detection portion, and it being a part, and making it output. 
[Claim 16] The static/dynamic detection process said judgment process judges 
**** for every pixel of said predetermined number to be. The activity judging 
process that the activity of which image of the picture signal generated at said 1st 
resolution conversion process and the picture signal generated at said 2nd 
resolution conversion process judges high ** more, When judged with the 
amount of [ of said predetermined number ] picture element part being a 
stationary part at said static/dynamic detection process The picture signal 
generated at said 1st resolution conversion process based on the judgment 
result in said activity judging process, The image-processing approach according 
to claim 13 characterized by having the selection-signal generation process 
which supplies the signal for the activity of said image of the picture signals 
generated at said 2nd resolution conversion process choosing the higher one, 
and making it output to said selection section. 

[Claim 17] Said activity judging process is the image-processing approach 
according to claim 16 characterized by judging the height of activity by computing 
the dynamic range of the pixel value of two or more pixels which can be set in a 
predetermined field, respectively, and comparing both dynamic ranges about the 



picture signal generated at said 1st resolution conversion process, and the 
picture signal generated at said 2nd resolution conversion process. 
[Claim 18] The image by the picture signal with which said 1st resolution 
conversion process is memorized by said frame memory, The motion detection 
process of detecting the motion between the images by said input picture signal, 
The image-processing approach according to claim 12 characterized by for the 
motion detected at said motion detection process amending a pixel location, and 
having image storage down stream processing which adds and accumulates said 
input picture signal in the picture signal memorized by said frame memory. 
[Claim 19] The attention pixel in the image according [ said 2nd resolution 
conversion process ] to said input picture signal, The class tap extract process of 
extracting two or more pixels containing the time and spatial perimeter pixel as a 
class tap. The class classification procedure which carries out a class 
classification according to the description of said class tap extracted at said class 
tap extract process, The image-processing approach according to claim 12 which 
defines image transformation data processing corresponding to the class 
concerned, and Is characterized by having the data-processing process which 
generates the picture signal of said high resolution by the defined data 
processing based on the class classified according to said class classification 
procedure. 

[Claim 20] Said class classification procedure Is the image-processing approach 
according to claim 19 characterized by carrying out the class classification of the 
description of said class tap with the pattern of the pixel value of two or more of 
said pixels as said class tap. 

[Claim 21] Two or more pixels of the field beforehand appointed about said input 
picture signal at said data-processing process corresponding to said class tap. 
By performing an operation with the operation multiplier about said two or more 
pixels beforehand set up according to the class classified in said class 
classification section The image-processing approach according to claim 19 
characterized by generating said output picture signal about said attention pixel 



in said input picture signal. 

[Claim 22] The process which extracts two or more pixels corresponding to said 
attention pixel from a teacher signal with said operation multiplier homogeneous 
as said output picture signal used at said data-processing process, The process 
which extracts two or more pixels of the location corresponding to said attention 
pixel from a student signal homogeneous as said input picture signal as a class 
tap, The process which carries out the class classification of the description 
about said attention pixel based on the description of said class tap. 
Corresponding to said class by which the class classification was carried out, by 
the operation with two or more pixels of the location corresponding to said 
attention pixel extracted from said student signal as a prediction tap The image- 
processing approach according to claim 19 characterized by computing as said 
prediction coefficient according to the process which derives the prediction 
coefficient for generating an output signal homogeneous as two or more pixels 
corresponding to said attention pixel extracted from said teacher signal from said 
student signal. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image processing system 
changed into the picture signal of high resolution from the picture signal of a low 
resolution, and the image-processing approach. 
[0002] 

[Description of the Prior Art] As a present television system, there are various 
things, such as a high definition method with more [ the so-called standard 
methods, such as 525 and 625, and the number of scanning lines per frame ] 



number of scanning lines per frame than it, for example, 1 125 Hi-Vision methods 
etc. 

[0003] In this case, for example by the device corresponding to a high definition 
method, in order to enable it to deal with the picture signal of a standard method, 
it is necessary to carry out resolution conversion of the picture signal of the 
resolution of a standard method at the picture signal of the resolution 
corresponding to a high definition method. Then, the resolution inverter of a 
picture signal using approaches, such as linear interpolation, is variously 
proposed from the former. 
[0004] 

[Problem(s) to be Solved by the Invention] However, although the thing with the 
conventional resolution inverter can output few conversion output images of 
degradation about a static-image part In the case of an image part with a motion, 
few conversion output images of degradation are obtained, but what has the 
problem that degradation of an image will arise in the case of the large image 
part of a motion, and has everything but the conventional resolution inverter 
About a stationary part, there was a problem that the image as motion partial was 
not obtained. 

[0005] That is, it was difficult to realize the resolution inverter which can form the 

image which corresponds exactly to both quiescence of an image, and a motion 

part conventionally, and does not have degradation. 

[0006] This invention aims at offering the image processing system and the 

approach that a high-definition resolution picture output with little degradation is 

obtained regardless of **** of an image, in view of the above point. 

[0007] 

[Means for Solving the Problem] In order to solve the above-mentioned technical 
problem, the image processing system by this invention In the image processing 
system which acquires the output picture signal which forms the image of high 
resolution rather than the image by this input picture signal from an input picture 
signal The image by the picture signal which is equipped with the frame memory 



which memorizes the picture signal of the image of the same resolution as the 
resolution of the image of said output picture signal, and is memorized by said 
frame memory, Said input picture signal by mal<ing it accumulate in said frame 
memory, amending a pixel location with reference to the motion between the 
images by said input picture signal The 1st resolution transducer which 
generates the picture signal of said high resolution to said frame memory, The 
description about the attention pixel in the image by the input picture signal The 
attention pixel. Carry out a class classification according to the description about 
two or more pixels containing the time and spatial perimeter pixel, and by image 
transformation data processing beforehand set up corresponding to the classified 
class By generating two or more pixels in the image of said high resolution 
corresponding to said attention pixel It is characterized by having the output 
selection section which chooses either picture signal of the picture signal from 
the 2nd resolution transducer which generates the output picture signal of said 
high resolution, and said 1st resolution transducer, and the picture signal from 
said 2nd resolution transducer as said output picture signal, and outputs it. 
[0008] In this invention of an above-mentioned configuration, since the 1st 
resolution transducer forms the picture signal of high resolution by accumulating 
image information in a frame memory over a period long in the direction of time 
amount, to a still picture and the image which carries out a pan and a tilt simply 
about a full screen, few conversion output picture signals of degradation are 
acquired. 

[0009] On the other hand, the 2nd resolution transducer the description about the 
attention pixel in the image by the input picture signal The attention pixel. Carry 
out a class classification according to the description about two or more pixels 
containing the time and spatial perimeter pixel, and by Image transfomriation data 
processing beforehand set up corresponding to the classified class Since the 
output picture signal of said high resolution is generated by generating two or 
more pixels in the image of said high resolution corresponding to said attention 
pixel, also in a motion part, few conversion output picture signals of degradation 



are acquired. However, about a stationary part, it is inferior to the 1st resolution 
transducer wliich treats image information for a long time in the direction of time 
amount. 

[0010] In the image processing system of this invention, since either picture 
signal of the picture signal from said 1st resolution transducer and the picture 
signal from said 2nd resolution transducer can be chosen and outputted by the 
output selection section for every pixel of a pixel unit or a predetermined number 
in consideration of the description of each aforementioned resolution transducer, 
a high-definition conversion output image with little degradation can be obtained. 
[0011] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of the Image 
processing system by this invention is explained, referring to drawing. The gestalt 
of the operation explained below is the case where this is changed into the 
output picture signal of the resolution of the image of a Hi-Vlsion method 
(henceforth HD) by mal<ing into an input picture signal the picture signal of the 
resolution of the image of the standard television system (henceforth SD) 
mentioned above. And with the gestalt of the operation explained below, as 
shown in drawing 2 , about every one attention pixel of SD Image, four pixels of 
HD Image are created and resolution conversion is carried out. 
[0012] Drawing 1 is the block diagram showing the configuration of the Image 
processing system of the gestalt of this operation. As shown in drawing 1 , in this 
example, an input picture signal is supplied to the class classification adaptation 
processing resolution conversion circuit 12 which constitutes an example of the 
2nd resolution transducer while it Is supplied to the high density are recording 
resolution conversion circuit 1 1 which constitutes an example of the 1st 
resolution transducer for every pixel. 

[0013] The image by the picture signal which the high density are recording 
resolution conversion circuit 1 1 is equipped with the frame memory which 
memorizes the picture signal of the image of HD, and Is memorized by the frame 
memory. Amending a pixel location with reference to the motion between the 



images by SD input picture signal, by accumulating SD input picture signal in the 
frame memory, the output picture signal of HD is generated to the frame memory 
concerned, and It mentions later about the detailed configuration to It. The 
resolution picture signal of HD from this high density are recording resolution 
conversion circuit 1 1 Is supplied to the output selection circuit 13. 
[0014] Moreover, the class classification adaptation processing resolution 
conversion circuit 12 The description about the attention pixel In the image by SD 
input picture signal The attention pixel, Carry out a class classification according 
to the description about two or more pixels containing the time and spatial 
perimeter pixel, and by image transformation data processing beforehand set up 
con^esponding to the classified class By generating two or more pixels in HD 
image conresponding to said attention pixel, the output picture signal of high 
resolution is generated and it mentions later about the detailed configuration. The 
resolution picture signal of HD from this class classification adaptation 
processing resolution conversion circuit 12 Is also supplied to the output 
selection circuit 1 3. 

[0015] The output selection circuit 13 consists of a judgment circuit 14 explained 
in full detail later and a selection circuitry 15, and the resolution picture signal 
from the high density are recording resolution conversion circuit 1 1 and the 
resolution picture signal from the class classification adaptation processing 
resolution conversion circuit 12 are supplied to a selection circuitry 16, 
respectively. 

[0016] Moreover, the resolution picture signal from the high density are recording 
resolution conversion circuit 1 1 and the resolution picture signal from the class 
classification adaptation processing resolution conversion circuit 12 are supplied 
to the judgment circuit 14. In the judgment circuit 14, from these two resolution 
picture signals, the motion and activity of an image by those picture signals are 
judged per pixel of a predetermined number, respectively, and the selection- 
control signal which carries out the selection control of the selection circuitry 15 
so that the resolution picture signal from the high density are recording resolution 



conversion circuit 1 1 or tlie resolution picture signal from the class classification 
adaptation processing resolution conversion circuit 12 may be chosen per pixel 
of said predetermined number is generated according to the judgment result. In 
this example, it judges which resolution picture signal Is chosen for every pixel, 
and a selection circuitry 15 is supplied by making that decision output into a 
selection-control signal. 

[0017] [Example of configuration of high density are recording resolution 
conversion circuit] drawing 3 shows the example of a configuration of the high 
density are recording resolution conversion circuit 1 1 used for the gestalt of this 
operation. This high density are recording resolution conversion circuit 1 1 is 
effective in resolution conversion of the quiescence, the pan simple at a full 
screen, and the image with a motion of a tilt except a scene change or a zoom. 
[0018] The high density are recording resolution conversion circuit 11 is equipped 
with a frame memory 1 10 as shown in drawing 3 . This frame memory 110 stores 
each pixel value of the picture signal of one frame of the resolution of HD image 
(refer to drawing 2 ). 

[0019] SD input picture signal is first supplied to the linear interpolation section 
111. From SD input picture signal, by linear interpolation, this linear interpolation 
section 111 generates the picture signal of HD Image, and outputs it to the 
motion vector detecting element 112. In case processing in this linear 
interpolation section 1 1 1 moves between SD input image and HD equivalent 
image in a frame memory 110 and performs ** KUTORU detection, it is for 
matching in the same image size. 

[0020] In the motion vector detecting element 112, motion vector detection is 
performed between the output image of the linear interpolation section 111, and 
the image of HD image currently stored In the frame memory 1 10. As the 
technique of motion vector detection, representation point matching by the full 
screen is performed, for example. In this case, it is detected, and moves and 
precision of ** KUTORU is considered as a part for a 1 -pixel unit in the image of 
HD. That is, in the input picture signal of SD image, it has the following precision 



by 1 pixel. 

[0021] The motion vector detected by tlie motion vector detecting element 112 is 
supplied to the phase shift section 113. According to the motion vector supplied 
to this, the phase shift section 113 performs the phase shift of SD input picture 
signal, and supplies it to the image storage processing section 1 14. In the image 
storage processing section 114, are recording processing with the picture signal 
memorized by the frame memory 1 10 and SD input picture signal which earned 
out the phase shift in the phase shift section 1 13 is perfomned, and the contents 
of storage of a frame memory 1 10 are rewritten with the picture signal which 
carried out are recording processing. 

[0022] The conceptual diagram of processing in the image storage processing 
section 14 is shown in drawing 5 . Although the are recording processing about a 
perpendicular chisel is shown since drawing 5 is easy to explain, are recording 
processing is performed similarly horizontally. 

[0023] In drawing 5 , a black dot is a pixel which actually exists and the white 
round head shows the pixel not existing. At this drawing 5 , in the motion vector 
detecting element 112, since the motion for 3 pixels was perpendicularly 
detected by the image of HD, the phase shift section shows the example which 
carried out the phase shift of the SD Input picture signal to those 3 pixels and a 
perpendicular direction. In this case, since the precision of the motion vector 
detected is 1 pixel of HD as mentioned above, the pixel location in SD input 
picture signal after a phase shift is equivalent to one in the picture signal of HD 
image memorized by the frame memory 1 10 of pixel locations, as shown in 
drawing 5 , 

[0024] And in image storage processing, as shown In drawing 4 , after adding 
mutually each pixel after a phase shift, and each pixel in the picture signal of HD 
image of the frame memory 1 1 0 corresponding to it, said corresponding pixel of a 
frame memory 1 1 is rewritten by the addition output pixel. That is, a motion 
compensation is performed to a motion of SD image, and help doubling of the 
pixel of HD are recording image and the pixel of SD input Image in the same 



location is performed. In addition, about this help doubling, a line intermediary is 
also good in weighting between HD are recording image and SD input image. 
[0025] As a result of the original SD image's being shifted by this image storage 
processing according to a motion vector in the precision of the 1-pixel unit of HD 
image and being accumulated in a frame memory 110, the image memorized by 
the frame memory 1 1 0 turns into an image of HD as shown in drawing 4 (B) to 
SD image shown in drawing 4 A. Although drawing 4 Is also an explanatory view 
about a perpendicular chisel, it is horizontally changed into HD equivalent Image 
from SD image similarly. 

[0026] The picture signal accumulated in the frame memory 110 by the above 
are recording processings is supplied to the output selection circuit 13 as an 
output of the high density are recording resolution conversion circuit 11 as an HD 
output picture signal. Since HD output picture signal from this high density are 
recording resolution conversion circuit 1 1 is what is generated by high density 
are recording processing of the direction of time amount of an image which was 
mentioned above, as the above-mentioned was also carried out, it can obtain HD 
output image except a scene change, a zoom, etc. which does not have 
degradation in the case of the stationary part of an image, and a simple pan and 
SD input image with a motion of a tilt, and does not have clinch distortion in it. 
[0027] However, another scene change part, another zoom part, etc. can move, 
and the class classification adaptation processing resolution conversion circuit 
which performs SD-HD conversion in the pixel unit of the predetermined number 
of one or more pieces explained below In the case of many parts can obtain HD 
output image of high quality. 

[0028] The class classification adaptation processing resolution conversion circuit 
used for [the example of a configuration of a class classification adaptation 
processing resolution conversion circuit], next the gestalt of this operation is 
explained to a detail. In the example explained below, according to the 
description about the attention pixel of SD input picture signal, the class 
classification was performed as class classification adaptation processing, the 



prediction coefficient beforehand gained by study for every class was stored in 
memory, and tlie processing whicli outputs tiie optimal presumed pixel value of 
two or more HD pixels corresponding to said attention pixel by data processing 
according to the weighting additive expression which used this prediction 
coefficient is adopted. 

[0029] Drawing 6 shows the example of an overall configuration of the class 
classification adaptation processing resolution conversion circuit 12 used for the 
gestalt of this operation. 

[0030] SD Input picture signal which should be processed is supplied to a field 
memory 121 . SD picture signal in front of 1 field is always memorized by this field 
memory 121 . And SD input picture signal and SD picture signal in front of 1 field 
memorized by the field memory 121 are supplied to the 1st field logging section 
122 and the 2nd field logging section 123. 

[0031] The 1st field logging section 122 performs processing which starts two or 
more pixels (a class tap Is called with explaining below) contained to the 1st field 
concerned based on the field (the 1st field) of two or more pixels set up 
beforehand, in order to extract the description of the attention pixel in SD input 
picture signal. 

[0032] The 1st field logging section 122 supplies the pixel value of two or more 
images cut down firom the 1st field to the class code generating section 124. The 
class code generating section 124 generates the class code expressing the 
description about an attention pixel from the attention pixel and its perimeter 
[ time and spatial ] pixel of said 1st field, and supplies the generated class code 
to a multiplier ROM 125. Thus, since two or more pixels which the 1st field 
logging section 122 starts are used for generating of a class code, as mentioned 
above, they are called a class tap. 

[0033] The multiplier ROM 125 has more specifically memorized beforehand the 
prediction coefficient determined by study which is mentioned later along the 
address relevant to a class code for every class. And a multiplier ROM 125 
receives as the address the class code supplied from the class code generating 



section 124, and outputs the prediction coefficient corresponding to it. 
[0034] On the other hand, the 2nd field logging section 123 extracts two or more 
pixels for prediction which contain the attention pixel contained to the pixel field 
for prediction (the 2nd field) from SD input picture signal and SD picture signal in 
front of 1 field which the field memory 121 has memorized, and supplies the 
value of the extracted pixel to the presumed operation part 126. 
[0035] The presumed operation part 126 performs a weighting operation as 
shown in the following formulas (1) based on two or more pixel values from the 
2nd field logging secfion 27, and the prediction coefficient read from a multiplier 
ROM 29, calculates two or more pixel values of HD image corresponding to the 
attention pixel of SD image, and generates a prediction HD picture signal. Thus, 
the pixel value which the 2nd field logging section 123 extracts is called **** and 
the prediction tap which are used in the weighting addition for generating a 
prediction HD picture signal. 
[0036] 

y=w1 xx1+w2 xx2+ .... +wn xxn (1) 

Here, they are x1, xn. It is each prediction tap and they are w1 , ... wn. It is 

each prediction coefficient. 

[0037] Next, with reference to drawing 7 , the example of the class tap started in 
the 1st field logging section 122 is explained. In this example, it shall be shown in 
drawing 7 and two or more pixels [ which is contained to the 1st field as a class 
tap ] the field where an attention pixel is contained and the field before that shall 
be included. 

[0038] In drawing 7 , the pixel which the pixel shown by the black dot shows the 
pixel of the n-th field (for example, odd number field), and is shown with a circle 
[ white ] shows the pixel of the n+lst fields (for example, even number field), and 
let class taps be an attention pixel and its thing which consists of two or more 
nearby pixels in time and spatially. 

[0039] And when an attention pixel is a pixel of the n-th field, it sets. It considers 
as the structure of a class tap as shown in drawing 7 (A). The attention pixel firom 



the n field, Two pixels [ six ] of the pixel of the upper and lower sides and right 
and left per piece which seven pixels with a pixel are extracted as a class tap, 
and adjoin an attention pixel spatially from the field before that are extracted at a 
time as a class tap. Therefore, a total of 1 3 pixels are started as a class tap. 
[0040] Moreover, when an attention pixel is a pixel of the n+1st fields, it sets. It 
considers as the structure of a class tap as shown in drawing 7 (B). The attention 
pixel from the n+1 field. Three pixels with the pixel per piece of the right and left 
are extracted as a class tap, and six pixels which adjoin an attention pixel 
spatially are extracted from the field before that as a class tap. Therefore, a total 
of nine pixels are started as a class tap. 

[0041] Also about the prediction tap started in the 2nd field logging section 27, 
the same tap structure as an above-mentioned class tap is used in this example. 
[0042] Next, the example of a configuration of the class code generating section 
124 is explained. With the gestalt of this operation, it is characterized [ of the 
attention pixel ] by two or more pixel value patterns cut down as a class tap in the 
1st field logging section 122. This description pattern makes each of that 
description pattern one class, although the plurality according to a class tap will 
exist. 

[0043] Using two or more pixel values started as a class tap in the 1st field 
logging section 122, the class code generating section 124 carries out the class 
classification of the description about an attention pixel, and outputs the class 
code which shows any of two or more classes beforehand assumed according to 
a class tap they are. 

[0044] In the gestalt of this operation, about the output of the 1st field logging 
section 122, the class code generating section 124 performs ADRC (Adaptive 
Dynamic Range Coding), and generates that ADRC output as a class code 
showing the description of an attention pixel. 

[0045] Drawing 8 shows an example of the class code generating section 124. 
Drawing 8 generates a class code by 1-bit ADRC. 

[0046] As mentioned above, 13 pieces or nine pixels are supplied to the dynamic 



range detector 21 as a class tap from the 1st field logging section 122. The value 
of each pixel is expressed by 8 bits. The dynamic range detector 21 detects the 
maximum MAX in two or more pixels as a class tap, and the minimum value MIN, 
and computes a dynamic range DR by the operation which becomes MAX- 
MIN=DR. 

[0047] And the dynamic range detector 21 outputs the computed dynamic range 
DR, the minimum value MIN, and each pixel value Px of two or more inputted 
pixels as the output, respectively. 

[0048] The pixel value Px of two or more pixels from the dynamic range detector 
21 is supplied to a subtracter circuit 22 in order, and the minimum value MIN is 
subtracted from each pixel value Px. By the minimum value MIN being removed 
from each pixel value Px, the normalized pixel value is supplied to a comparator 
circuit 23. 

[0049] The output (DR/2) of the bit shift circuit 24 which sets a dynamic range DR 
to one half is supplied to a comparator circuit 23, and the size relation between 
the pixel value Px, and DR/2 is detected. And when the pixel value Px is larger 
than DR/2, the comparison output of 1 bit of a comparator circuit 23 is set to "1", 
and as shown In drawing 9 , when that is not right, the comparison output of 1 bit 
of a comparator circuit 23 is set to "0." And a comparator circuit 23 parallelizes 
the comparison output of two or more pixels as a class tap obtained one by one, 
and generates the ADRC output of 13 bits or 9 bits. 
[0050] Moreover, a dynamic range DR is supplied to the number-of-bits 
conversion circuit 25, and the number of bits is changed into 5 bits from 8 bits by 
quantization. And this dynamic range by which number-of-bits conversion was 
carried out, and an ADRC output are supplied to a multiplier ROM 125 as a class 
code. 

[0051] In addition, if it is made to perform not 1 bit but the many bits ADRC, of 
course, the class classification of the description of an attention pixel can be 
carried out more at a detail. 

[0052] Next, study, i.e., the processing which obtains the prediction coefficient 



stored in a multiplier ROM 125, is explained with reference to drawing 10 . Here, 
the same reference mark was given to the component in the class classification 
adaptation processing resolution conversion circuit 12 of drawing 6 , and the 
same component. 

[0053] HD picture signal (a teacher signal is called) used in order to learn is 
supplied to the infanticide processing section 31 and the normal equation adder 
unit 32. The infanticide processing section 31 performs infanticide processing 
about HD picture signal, and supplies the student signal which generated and 
generated SD picture signal (a student signal is called) to a field memory 121. As 
explained with reference to drawing 6 , the 1 field of the student signal in front of 
1 field is memorized in time by the field memory 121. 

[0054] In the latter part of a field memory 121, the processing mentioned above 
with reference to drawing 6 and the almost same processing are made. However, 
the prediction tap which the class code and the 2nd field logging section 123 
which the class code generating section 124 generates extract is supplied to the 
normal equation adder unit 32. A teacher signal is further supplied to the normal 
equation adder unit 32. The normal equation adder unit 32 performs computation 
for solving a normal equation based on these three kinds of inputs, and the 
prediction coefficient decision section 33 determines the prediction coefficient for 
every class code from the computation result. And the prediction coefficient 
decision section 33 supplies the determined prediction coefficient to memory 34. 
Memory 34 memorizes the prediction coefficient supplied. The prediction 
coefficient memorized by memory 34 and the prediction coefficient memorized by 
the multiplier ROM 125 ( drawing 6 ) are the same. 
[0055] Next, a nonnal equation is explained. It sets at an above-mentioned 

ceremony (1), and they are prediction coefficients w1 wn before study. It is 

an undetermined coefficient. Study is performed by inputting two or more teacher 
signals for every class. When writing m [ the number of classes for every class of 
a teacher signal ], the following formulas (2) are set up from a formula (1). 
[0056] 



yk =w1 xxk1+w2 xxk2+ .... +wn xxkn (2) 
(k=1.2.-. m) 

In m>n, they are prediction coefficients w1 , wn. Since it is not decided that it 

will be a meaning, it is the element ek of the error vector e. It defines by the 

following formulas (3). 

[0057] 

ek =yk-{w1 xxk1+w2 xxk2+ .... +wn xxkn} (3) 
(k= 1 , 2. -, m) 

And it is determined that a prediction coefficient makes into min the error vector e 
defined by the following formulas (4). That is, a prediction coefficient is set to a 
meaning with the so-called least square method. 
[0058] 
Equation 1] 

IT 



[0059] e2 of a formula (4) As the practical count approach for asking for the 
prediction coefficient made into min, it is e2. It is each prediction coefficient wi so 
that a partial differential may be carried out with a prediction coefficient wi (1 i= 
two ....) (the following formulas (5)) and a partial-differential value may be set to 0 
about each value of i. What is necessary is just to set. 
[0060] 
Equation 2] 

IT 



[0061] A formula (5) to each prediction coefficient wi The concrete procedure to 
define is explained. They are Xji and Yi as shown in a formula (6) and (7). If a 
definition is given, a formula (5) can be written to the form of the determinant of 
the following formulas (8). 
[0062] 



Equation 3] 



0" 



[0063] Generally an equation (8) is called a nonrial equation. Based on three 
kinds of inputs mentioned above, the prediction coefficient decision section 33 
computes each parameter in a normal equation (8), performs computation for 
sweeping out further and solving a normal equation (8) according to general 
matrix solution methods, such as law, and is a prediction coefficient wi. It 
computes. 

[0064] The class classification adaptation processing resolution conversion circuit 
12 cames out the class classification of the description of the attention pixel of 
SD image as mentioned above, and two or more pixels of HD image 
corresponding to an attention pixel are created by performing the presumed 
operation using the prediction coefficient prepared beforehand based on the 
classified class. 

[0065] Therefore, since the prediction coefficient which corresponds to the 
description of the attention pixel of SD image exactly can be chosen, it can 
create by performing a presumed operation using such a prediction coefficient 
good [ two or more pixels HD image corresponding to an attention pixel ]. And 
also when there is a motion, an resolution picture signal with little degradation 
can be acquired. 

[0066] Thus, although an resolution picture signal with little degradation can be 
acquired in the class classification adaptation processing resolution conversion 



circuit 12, without being dependent on quiescence of an image, and a motion, 
about a simple motion of tlie whole image, such as a perfect stationary part 
which was mentioned above, and a pan, a tilt, it is inferior to an resolution picture 
signal from the high density are recording resolution conversion circuit 1 1 which 
can accumulate the information on a long frame. 

[0067] He is trying to acquire appropriately a resolution conversion output picture 
signal with more little degradation from the output selection circuit 13 in the 
gestalt of this operation taking advantage of the above descriptions of two 
resolution conversion circuits 11 and 12. That is, in the output selection circuit 13, 
it judges whether which resolution conversion output is chosen, and it controls by 
the judgment circuit 14 so that a suitable resolution conversion output picture 
signal is acquired from a selection circuitry 15 by the decision output. 
[0068] Next, while explaining the detail of the judgment circuit 14, the selection 
actuation by it is explained. 

[0069] the judgment circuit 14 - setting -- the resolution picture signal from the 
high density are recording resolution conversion circuit 11, and the resolution 
picture signal from the class classification adaptation processing resolution 
conversion circuit 12 - difference ~ the value calculation circuit 141 is supplied - 
having - both difference - a value is computed, and the difference ~ a value is 
absolute-value-ized in the absolute value-ized circuit 142, and is supplied to the 
comparison test circuit 143. 

[0070] the comparison test circuit 143 - the difference from the absolute value- 
ized circuit 142 - the absolute value of a value judges whether it is larger than 
the value defined beforehand, and supplies the judgment result to the selection- 
signal generation circuit 149. 

[0071] the selection-signal generation circuit 149 ~ the difference from the 
absolute value-ized circuit 142 from the comparison test circuit 143 ~ when the 
absolute value of a value receives the judgment result of being larger than the 
value defined beforehand, the selection-control signal for choosing the resolution 
resolution picture signal from the class classification adaptation processing 



resolution conversion circuit 12 by the selection circuitry 15 Is generated, and a 
selection circuitry 15 is supplied. 

[0072] Tiius, choosing is based on the following reasons. That is, as the above- 
mentioned was also carried out, in the case of the high density are recording 
resolution conversion circuit 1 1 , there is little signal degradation by quiescence, 
the simple pan, and the image of a tilt, but degradation is looked at by the picture 
signal to rotation, a motion called deformation, and a motion of the object in an 
image. Therefore, when the level of the output pixel of both resolution picture 
signal from the high density are recording resolution conversion circuit 1 1 and 
resolution picture signal from the class classification adaptation processing 
resolution conversion circuit 12 differs extremely, it is thought that it is based on 
said degradation. 

[0073] therefore, difference -- the difference computed in the value calculation 
circuit 141 - it is better to use the resolution picture signal from the class 
classification adaptation processing resolution conversion circuit 12 which can 
respond also to the above motions, when the absolute value of a value is larger 
than the threshold defined beforehand, the above thing shows - as - difference - 
- the value calculation circuit 141, the absolute value-ized circuit 142, and the 
comparison test circuit 143 constitute the static/dynamic detection circuit of an 
image. 

[0074] next, the comparison test circuit 143 - the difference from the absolute 
value-ized circuit 142, when it judges that the absolute value of a value is smaller 
than the value defined beforehand The selection-signal generation circuit 149 so 
that It may explain below The resolution picture signal from the high density are 
recording resolution conversion circuit 1 1 , The selection-control signal it is made 
to output a pixel with the larger activity of the resolution picture signals from the 
class classification adaptation processing resolution conversion circuit 12 from a 
selection circuitry 15 is generated, and a selection circuitry 15 is supplied. With 
outputting a pixel with larger activity, the Image which does not have high dotage 
of activity more can be outputted. 



[0075] In addition, as a norm of activity, tlie dynamic range of the specific region 
which consists of two or more pixels before and behind the attention pixel of said 
SD image about the resolution conversion output signal of HD Is used In this 
example. 

[0076] For this reason, in the judgment circuit 14, the resolution picture signal 
from the high density are recording resolution conversion circuit 1 1 and the 
resolution picture signal from the class classification adaptation processing 
resolution conversion circuit 12 are supplied to the activity operation field logging 
sections 144 and 145, respectively. 

[0077] The activity operation field logging sections 144 and 145 start two or more 
pixels before and behind the attention pixel of said SD image as shown in 
drawing 1 1 (B) and (C) as a pixel of an activity operation field about the 
resolution conversion output signal of HD from the high density are recording 
resolution conversion circuit 1 1 and the class classification adaptation processing 
resolution conversion circuit 12. 

[0078] The dynamic range detectors 146 and 147 are supplied, respectively, and 
the two or more pixels [ which was started as an activity operation field ] dynamic 
range in said activity operation field Is detected, respectively. And those detection 
outputs are supplied to a comparator circuit 148, the magnitude of both dynamic 
range Is compared and the comparison output is supplied to the selection-signal 
generation circuit 149. 

[0079] the selection-signal generation circuit 149 ~ the decision output of the 
comparison test circuit 143 ~ difference ~ when it Is shown that the absolute 
value of a value is smaller than a predetermined threshold, based on the output 
of a comparator circuit 148, the two or more pixels dynamic range cut down as 
an activity operation field generates the selection-control signal chooses the 
resolution conversion output of the larger one and it is made to output, and 
supplies it to a selection circuitry 15. 

[0080] Actuation of the above judgment circuit 14 and a selection circuitry 15 is 
explained further, referring to the flow chart of drawing 12 . Actuation of the flow 



chart of this drawing 12 corresponds, also when software processing realizes the 
output judging circuit 13. The following explanation describes the example which 
chooses the more suitable one per pixel among the output of the high density are 
recording resolution conversion circuit 11, and the output of the class 
classification adaptation processing resolution conversion circuit 12. 
[0081] first, the difference of both pixel - a value - computing (step SI 01) - 
difference - it judges whether the absolute value of a value is larger than a 
threshold (step SI 02), and In being large, it chooses and outputs the conversion 
output picture signal from the class classification adaptation processing 
resolution conversion circuit 12 (step SI 07). 

[0082] next, said difference ~ when the absolute value of a value is small, per 
activity operation field mentioned above, both activity is computed (steps SI 03 
and S104), both the computed activity is compared (step S105), and a pixel with 
larger activity is outputted (steps SI 06 and SI 08). The image which does not 
have high dotage of activity thereby more is chosen and outputted. 
[0083] in addition, the thing restricted to this although the dynamic range in the 
specific field sunrounded by the dotted line as shown in drawing 1 1 was used In 
the above-mentioned example as a norm of activity - It is not - other than this - 
being also alike ~ for example, the difference of the distribution in a specific 
region, and an attention pixel and the pixel of the neighbors - the absolute value 
sum etc. can also be used. 

[0084] Moreover, in explanation of the above selection processing, although the 
case where it chose per pixel was explained. It may not be limited to what is 
chosen per pixel, and you may be a block unit, an object unit, a frame unit, etc. 
[0085] Moreover, in the above example, although considered as selection of 2 
person alternative with the output of one high density are recording resolution 
conversion circuit, and the output of one class classification adaptation 
processing resolution conversion circuit, a high density resolution conversion 
circuit and/or two or more class classification adaptation processing resolution 
conversion circuits are prepared, respectively, and an output picture signal can 
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be chosen from them. 

[0086] Furthermore, the class tap and prediction tap in the 1st field logging 
section 122 and the 2nd field logging section 123 in explanation of class 
classification adaptation processing are an example, and it cannot be 
overemphasized that it is not what is restricted to this. Moreover, although 
structure of a class tap and a prediction tap was made the same in above- 
mentioned explanation, both do not have to be taken as the same structure. 
[0087] Moreover, although the gestalt of above-mentioned operation was 
illustrated about the conversion in HD image from SD image, it is applicable to 
conversion of not only this but all resolution. Moreover, class classification 
adaptation processing and high density are recording are not limited to the thing 
of the above gestalten, either. 
[0088] 

[Effect of the Invention] Since the result of the high density storage structure and 
class classification adaptation processing in which the information on the 
direction of time amount can be treated for a long time can be chosen for every 
pixel according to this invention as explained above, a high definition image 
without degradation can be outputted. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram of the gestalt of operation of the image 
processing system by this invention. 

[Drawing 2] It is drawing for explaining resolution transform processing performed 
with the gestalt of operation of the image processing system by this Invention. 
[Drawing 3] It is the block diagram showing the configuration of an example of 
the 1st resolution transducer used with the gestalt of operation. 



[Drawing 4] It is drawing for explaining transfomi processing of the 1st resolution 
transducer of drawing 3 . 

[Drawing 5] It is drawing for explaining transfomi processing of the 1st resolution 
transducer of drawing 3 . 

[Drawing 6] It is the block diagram showing the configuration of an example of 
the 2nd resolution transducer used with the gestalt of operation. 
[Drawing 7] It is drawing used for explanation of the processing actuation by the 
2nd resolution transducer. 

[Drawing 8] It is drawing showing the example of a configuration of some circuits 
of the 2nd resolution transducer. 

[Drawing 9] It is drawing for explaining actuation of the circuit of drawing 8 . 
[Drawing 10] It is drawing for explaining the generation method of the multiplier 
memorized by the multiplier ROM which Is a part of 2nd resolution transducer. 
[Drawing 11] It is drawing used for explanation of selection processing of the 
output picture signal in the gestalt of operation of the image processing system 
by this invention. 

[Drawing 12] It is a flow chart for explanation of selection processing of the output 
picture signal in the gestalt of operation of the Image processing system by this 
invention. 

[Description of Notations] 

11 - A high density are recording resolution conversion circuit, 12 - Class 
classification adaptation processing resolution conversion circuit, 13 [ - Frame 
memory, ] - An output selection circuit, 14 - A judgment circuit, 15 - A selection 
circuitry, 1 10 1 12 ~ A motion vector detecting element, 1 13 - The phase shift 
section, 1 14 - Image storage processing section, 122 - The 1st field logging 
section (class tap logging section), 123 ~ The 2nd field logging section 
(prediction tap logging section), 124 -- The class code generating section, 125 - 
A multiplier ROM, 126 - Presumed operation part, 141 -- difference - a value 
calculation circuit and 142 ~ an absolute value-ized circuit, a 143 - comparison 
test circuit, 144, the 145 - activity operation field logging section, 146, and 147 - 



dynamic range operation part, a 148 - comparator circuit, and a 149 - selection- 
signal generation circuit 
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<onm=^iztimma^mn^Kf^mimmt^z 

[0007] 

[8iis«W'%r<&/i:«(o#@i] jmms^fum^tz 

6. z<D\timistmmzi:^m»^*JtMmmm<om9i 
^Bm!&aitimm^^^imim^mz^\,^T> 

msiOitimmm^ommmmmtm cmwmcojsm 

iS«fi#«iB«-r57U-i»p<€'/i&lijl. b}BB7U- 
L.p<t'JtclB18*nTt^*iiS!<i^c*S@lfi!t. sasB 
A^iHMi9(ci:%lifil^:0!)l»7Oii»«$[!iL7ii« 
ffill«ffiiE«LS/j<6. BulBA^eS«fl#«B3IB7U- 



<5) 



2002-223420 



[0 0 0 9] «2(o«fiiis3S»is», xfimm 
^^cJ:5iHS^«^'<D>^eilS^^:ol^To^tm«x -f-tDJia 

[0 0 10] z<ont»(ommm&mctei^Tii. ma 
mm&ommmz. tbttmmzav. ml^m^<r)mm 
6<Dii«fi#©t>-rn6^*«)iBfirti#*aBR lt** 

[00 111 

D ^ t^ 3 ) OlIigi(DSi<liS<0m^Sili(l^(c3E)li-r 

2lJ:5^-r*3lc. SDli®(O1ll0;±a^^S^c■^l^ 
7. HDi@iUD4lB<DS%«£iJ£UT. «1SlSSI$|-r% 

[0 0 1 2] BI1 z<omi&(DBm)mmsim&m<o 



{0 0 13] u®mmmmm.^tmm^ i». hd« 

«!^. SDAAiI1&f§#lzJ:%affii^0!)lll7(Oii$«# 

ai^sifl^mi 3(c^$g;rn^o 

[0 014] $fc. '977^^fS;Ui^€!lS3SI6l5]» 
I2tt. SDA:^3iii(&<t#ttJ:5iii®«fO>iaiii5gl!:o 

tiPS^r^Hv^mtixDm^mm^^r^zt^zi: 

SIE^iaSSl 2d'6(DH D:fS^OSi6gH6tf§#<l>. lUA 
3ljRlsl%i 3(c««$g;i:n%. 

{0 01 s] tb^aiRisisii 3». ^^fi^at-rsfij^isi 

»1 4<!:. a«EI»1 5<!:6>6fty. ®e)g§«3l»®S 

[0 0'1 6] $/cs -SSS#Slf9¥1SilgSSI3ls]t3l Db^e 

1 26^S©Sg!iS<a€^<!:W. ipJ^SSl 4tc«figa:n 
¥iJ£lslKl 47». •^ne2O0:)S)Aii«i(i#i!>' 

®S$iSS8Si 2)b^6a)S}eiii©«^<Di>-rnjb^-:* 

[0 0 17] mmmsmmi&mmk^^ommm'i m 
3it. caimmo)Bmizmi^'iti^nmmmmmf&m^ 

fii<si^«iisissi 5/->f^i>-:^^f»x-^«i»L^ 



(6) 
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[0 018] umswmiSlmmmK^ isisic 
-^pi'Eij 1 1 Hommiis^omim (@2# 

SB) <)!)17U-A(DHflMl^©SiSi!Mi*ttWir*o 
[0 0 1 9] S DA^ii]«!«^tts $-r. igJ^FagPI 
1 UC«tJ&S-n5„ C<7)$l«tiiHgI51 1 Itt. SDA^ 

[0 0 2 0] W}^<'yh)Vi^$m^ i 2T'1±. emffis 

8B1 l.l®ai*li«i:s 7b-Ayt'J1 l OlcSilS 

Ilia's: /7 h;KDlS)Sl*, H D♦SlOiaS!^ciil^T 1 @jR 
«(Ik^^:r^. 0$tl. S Dli1i(0A^BSflKE^7». 

[0021] h;l/«iajSi51 1 2T'«ai*tl/'cl(l 

^'^^^^ hAH*. ■ffiffl5/7 KSPI 1 3lc«»gJtl«. ffiffl 

5/7 hfiui 1 3«:. znmm&ttmis^^^^ h;HClS 
CT. SDA^iiiS!€^0faffl->7h«m\ 

1 4(c^r^. iii»S8i«&ssi!i i Avit. 

7b-i^ytyi 1 OtClBig*ftTL^«iiiflrti#t. ffi 
*i->7hSm 1 37tt«->7hL/!:SDA^il«!fi^»i: 

-A/t'j 1 1 oa)i2iirtS*»$Jftji«o 
[0 0 2 2] msm9^im3^ 4T*o)«imp>m$im^m 

[0 0 2 3] 05(c£i>7> mt»M. mmtc^nm 

5T'«. at/^^h^l/ttaiSIJI 1 2lt*>lNT. HDfflS 

ffl*i->7hsi5T\ sDxtimsm^^s ^osmin^. 

Dffll© 1 tt!|i->7 h»<J!)S D A*« 

1 1 oitiBis*nTi^5HDii®ffli<Dia 
[0 0 2 4] ^LZs inasfasasicfeiNTJi. 

7h^®SiiiiRis ■?-nicJsH6-r57b-A;<€'J 1 1 
00:>HDiS<i!4i^<OiiiSKt#ic£(t^«liiR^%. '^4 



il«*dtcr«c o^y. SDHffll(Oi)*<i:«LTl!j* 
ffi««?7t\ I^CttWc<B5HDSfflil«(DIiii!fiSD 
A^ii®©iiliR<DSL$fc**ff5t><0T»*. a»» 
C(D£L^t>4t(cnLT». HD&IRlIft^:. SDA:^ 

[0025] z(omm9i!imiz<ii y . 5t<D s d 
T5/7h#nT. 7U-Aytyi ioics«*n5is 

l2I4A{c5^-rSDiii«l!:«LT. 7U-A;<ty 1 
1 0(clB1g?n5iiiffli»*x E4 ■(B) lC/T^rJ:-5ftHD 

:!KV:&lRl(cot^T«>1^(cSDlIftA'6 

[0 0 2 6] ±ai(0J:oftSfB«iatc*y7WAp«* 
y i 1 ou:s«*nfciifflrti#««. tiomtimsim^t 

h©«)**J^OSDA*HlS!©Ji^lCli. «<b*i«*<^ 
<>0. drySLSA^CDftt^HDtU^Bft^^^CdzAt? 

[0 0 2 7] L6^U ^■nW^O-V-V^iVv'SB^^ 

r*. 1 <iJi(±omsa<D®««ta7<os d - h 
[0 0 2 8] i'?'77.iiimmmmmmmwsifi)m 

[0 0 2 91 E6ttv ^:(DllSfi©^g!^l^cffl^/^6n•5^'7 
(0 0 3 0] ffla*n5'<*soA^iSfi!(i#ii7-f- 

;l/Kyty 1 2 1 tc«9g*ti*o J:<D7-r-;bKp<^y 
1 2 1 mi*^^ 1 7-f-;U Kb3©S Diiiffllfi#««8BiS* 
n7t>«, f-LTv S DA^il«ifl'^<!:. 7'r-;UKp< 

ty 1 2 1 ^csB1S^nTt^5 1 7-f-iU Kgjws ds® 
m^L&^2 3^cm&tmo 

[003 1] mifi^iJiyaitSPI 2 2lj:. SOA^Hi 
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[0 0 3 2] ^I^SJsEWUaiLSIJl 2 2tt. mUSlSEA^ 
6Wy UJ LfcffiSfiS«i<DilJRfil*->7:^=i- 1 
2 4tc«Sg-r«„ -f^xa-HmSPl 2 AH. ButBS 

[0 0 3 3] fi^ROMI 2 5(i. Mmt^Ji^^^fi^m 

Ictt-^^XD- K(cBiar«7 KU7(C^oTs ^46!B 

y=wi Xxi +W2 Xx2 +•'• 
ZZ-P. XI, •• •, xn fi^S^^D^'y^-pSys 
wi . wn ii^S^S!l«aT'»«o 

[0 0 3 7] ia7s#gaLT. m^mmw)liiL 
fipi 2 2T«yiHarn«^^5x^'yro5«ij«i)tt8r*. 

[0 0 3 8] 07lCfct^T. ll3tlT'5^-riS»4v Sn7 
-f-;UK («|jLtfSa7'f-;UK) ©iSJR^g^U « 

fc. B^Tmmmits mn+1 7-f-;uK (marffl 

mist 6^6*5 t>©i: 

[0 0 3 91 ^-LTv '^mmm^mny^-ivmmiit 

(Dt^iC^L^Tli. 07 (A) tC5^-r«J:5'S:'>5X^fy 

■^^(ommtsnTis y . -to n 7 -r -/u Kft^stiaeii 

OBijRt©7{aOiiiiR««^'57.^77t LTttttJ^tlv 

i.6<i(DiiiSg6^^5X^i-j/:/<!:LTttai*n-5o Lfcfl« 
oT. -^tfl 3ffl©iajR«'^5X^'yytLTiJ!jym* 

[0040] $fc. aSliiSJti^m n + 1 7 -f -it! K®ffii 
jR<Di:*»Ctel>Ttt> E7 (B) lzmrii^tS:<7=77.^ 
yy<ommt-ttiTSS*J. ^Wn + 1 7'f-iUK*>6« 
aaiijS t . i<OtEM<n 1 ^i-roroii^i:© 3 <iOHiR 



{0 0 3 4] S2«iJa«yaiLaJi 2 3tts so 
Ktmsm^t. 7-f-/uKp<ty 1 2 1 jSi^seiSLTc^ 

« 1 7-r-iU KMos Diiiffl!(l#<!:6>e. ^SlIfflWiliJR 

{0 0 3 5] itsstssisi 2 6tts m2m.m\^\.^ 

tSr 5 H D Si«©ffia(i<7)iiiiRffl^3i46T. H D IS 

{0036] 
•+wn xxn (1) 

[0 04 1] S2fiH«yaiLgi52 7THJ]yill*ni.^f 

[0 0 4 2] *tC, ^75XI>-K58afea51 2 4©«b«fly 

asLSPi 2 2T'^'7x^f>:rtLT«iyai?n-5ffiaffi! 

[0 0 4 3] ^7Xa-K5e*aJ1 2 4tt. SlfSJSK!) 

y ai US5 1 -2 2 T'^ LTijoy aji-tirc«ia 

[0 0 4 4] ilOIIBfiWJKJUcfcl^TJiv ^7X3- K 

SKfeSJi 2 4tt. sitsawymuaji 2 2ott*ico 

U'^Tv ADRC (Adaptive Dynamic 
Range C o d i n g) *?7C\ ^■©A D RjCJli^ 

[0 0 4 5] BIStts ^'5X=l-Kfe^aJ1 2 40!)-«| 
Sg^-To S8«. ieyhAO«CiC*oT. ■J'^Xa 

[0 0 4 61 ^f'r^5 y^'U>>?«liligB2 1-(C»4. S9 
xELfc^^tc. mi fiJsE«jyfflL8P1 2 26^6. ■J'^X 
^«'i/:^i:LTx 1 3il«%U49<iOSUR6M«JS3-tl 

^f'f-^5y^uv-:^tta«3B2 m» ^^^x^iyrtu 

T<Dffiai@(DlijR<©*(Dfi*ffiMAX.!:. S/Jx«SM I N 
^««aiU MAX-M I N = DRfl:53[Wc*oZ. 
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[00471 ^^LT. ^<''r:^5•y^^>v^«^^Jl2lK2 1 
t. g'jxfiiM I tits Ati-inrcm.m(om^ii<oit\.^ 

[0 0 4 81 ^f'<-^-5'y-5'U>->'«!lHHlK2 

skiioBjiitDiiii^p x(i. 'mm 2 2imizmkt 

igfflPx6^6«'hfilM I NAi«|^**n«CtT\ iBiaft 
**X/c@iSRffl)b'«Jt«l2l!S2 3 lc«Jgi-ft5o 
[0 0 4 91 lt«|£l!S2 3tJ:«. ^f'r:f5'J/^U>->'D 
R*1/2tcr«fcfy h->7K0B2 4<Dlll* (DR/ 

2) jti^igs-tu mf^mpxtDR/2t(D±'mm'^ 

DR/2J:y*$l''^tCtt. tk«l2l!S2 3<01 

2 3©1 tf y hOtb®ai^*i« '0" t^tlSo *LT. 

9 try hO!) A D R C ttS^SSI^-r^. 
[0 0 5 01 $fc. ^f'r-fS'y<'U>S>DR«'e-;/ ha 

[0 0 5 11 1 tr-y hT'«:ft<, ^t-yhADR 
[0 0 5 21 3»!fC> fftto-S, «aROM 1 2 5 

yk =wi Xxk1+w2 xxk2+* 

(k = K 2s m) 

m>n©Ji^. ^Wm)N\ . • wn li-StC>*$ 
ek =yk - {wi xxk1+w2 > 

(k = K 2, "N m) 
^•LT. WTWiC (4) icioT^e^nSi^S'^^'H 

fftto-S. t^t)i*«S'Jv2iiaKJ:oT^iiJfiya«-S 
[00581 

[ttll 

e^- 5j • • • (4) ' 



ssiiiEiKi 2^<mm%tmmmism!Lit. m 

[00531 ^ss^7■5fc^^>^cfflt^6tl5 h ^^mm 

mi^mmamm ncimtn^, tamumi^ i 
t*. HDlIS!€#^cc)L^TS?l$iaa«^7oT. s-o® 

#«7<f-ibK^«'J 1 2 UC««Sr4. BI6*#!!aL 
Ti«B8U/c*3(C. 7-f-iUF;<t'J 1 2 Hctt. I^ffl 

Wtc 1 7-f-;i/ Kii<Dt^^ 1 7'f-/i/ Kfi«lBlgir 

(0 0 5 41 7-f-)U K/=E'J 1 2 1 0!)«Stu«5l^T 
«v ia65#S9LT±a!Lfc«iag<hBlflll«|3S:fflii6^a 

jnso ■fiu -^^xn-Hmsji 2 4A^584-r5^ 
Ktejctfn 2fiisEiioy tti L85 1 2 3 fi^aairs 
"Pii^yrtts iEm^m.na9m3 2izm6i[*i^o ie 

iEj^e^AD»S3 2(i. <:ne3ll«(DA^(CS 

o^3iy«a«-3iS-r«o ^-tr, ysyfi5a>*«aJ3 3 

3 4tt. ««ig;rn^?ay«Ka«8Biir«. ^%u3 4(c 
HEWitn^^mmt. «aROMi 25 <h6) jcjb 

[0 0 5 51 mzs jEJs^escic^tNTiK^^r*, ±2E 

(OSC (1) U:«l>T. ¥B|i»*^^3PJffl5awi , w 
n ««*^flgaT'i65o ^^{4. ^7 7;^€lcffia©»6ili(i 

Ulia^m^SiB-r^li^. £C (1) UTOA 
<2) i/«!9S*ns. 
[00561 
••+wn xxkn (2) 

(3) 7S«r«o 

[00571 

xk2+'"*+wn Xxkn} (3) 

[0 0 5 91 SC (4) (Oei «fi'hfr«^3IOflfia«« 

Wi (i =1. 2----) ^ii»»L <WT<D^ 

(5)), ios«iu:o^,^T^sa»«lfl«o^a5*3t£ 

[00601 

[a2i 



m 
k=0 



<9) 
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[006 1] ^ (5) A'6ft73H«^wi ^^tb^m 

m^mitoi^Ttmr^o « (6) . (?) <oj:-5ic 

Xji. Yi ^^m^t. ^ (5) li. WTOiC (8) 

<n'mm.<m\t.m <cttn'^^o 

[0062] 
[tt3] 



Ex 



kl 



(6) 



(T) 



^21 ^22 



^nl ^n2 



^2n 



(8) 



[0 0 6 3] ^ (8) i^mciEm^mAmigix^'k 
^^cs^l^Tv JEk'^m^ (8) "f'os/N?/— siss 

TiE«^Sa (8) *»<fci6a)ft©Jaa*?7oT^3I!l 

[0 0 64] JjU:©<fc-5lcLTs '5'5X»S®)SjlBS« 
1SilSE)$»lal!Sl 2 a, SDBi»<0)iSiiijg<0l$at«^7 

mmcns&r^ h DiKia>«fiiiiis%0j)§-r ^. 

[0 0 6 5] Ltzt^nTs S Dii«(D-^SSj!((04$a»i: 

■?-<0 J: 3 LT}i^-»W5t73 C t J: 

)iSill!l(cjt^{E;-r%HDiiiigico%»iijj||^g»(ciJ 

[0 0 6 6] ziojcatc, '2'7X^iiSfS;«asiK«JSS 

[0 0 6 7] COHSSOmffilCJiC^Tttx Ji(±0J:5 
20<DfK«JglSS»ls]!%1 K 1 2(Dl$gl[%^A'L 

aj^s»?0Ki 3T'ii. i<on^mtli^ 4T% t^-r 



[0 0 6 8] tame, ^•s!m^ 4(D»«BHEot>Ti»wr 

[0 0 6 9] fiJjtSSSi 4(c^^lN7(j:v SffiiSSffiDS^ 

mm\m'^^ 4 1 it«jgjtiT. s«©siMi««»aj? 

ns, *LT. f-OS»ffl*i«»6}>ffil<kl2lB1 4 21CTI6 

^mii'n, ibiefiJsisiESi 4 3(c«»g;!;n%. 
[0070] \icm\wm 1 4 3 T'\t. mmtm^ i 

[007 1] 3l^{t#£^(s]!S 1 4 9 (i. tklSf>JSIs]!g 

I 4 36^6. «6J*miHl»1 4 26^e<Dll»fi5<DI6«ffi 

$tc». '97X^iBiis;fflsiKfi!SS»@ei 26'do!) 
i»®)es»!®®ffl#«a»?iaiKi 5Ta»!-r5j:3tc-r 

[0 0 7 2] c:oJ:dlCjS»?-r5<0(i. JJ(T©J:3SS 
iii«!f©*:/v>'i^hoW)*H:}<tLTtt, iiiffl!ffl# 

ei 1 ft^eosstBfiifi^^. -i^^x^sisisiEiiDiift 

filE^lslSSl 2A>60!)St$liS«ft^^(Dii^#Ott]^iSi!( 
[0073] Lfcfi«oT. S»1i»ailsltt 1 4 1 7»Wffl 

^[i)ii;s;)ia^«iS3&«iisi%i 2t''ioa)wmf».^^^ 

ffl»iii@!s 14 1. mm\m^ 142. ^^ijsisik 
i4 3». mmi»mmm^mm^^<r)x^tb^. 

[0 0 7 4] IfclSliiJJtlslKl 437, t&^mial 

Kl 4 2)!)^6<DS»ffi©J63>H16\ •?«)!E4&/i:fiI J: U t 
/h?l,Ni!|iiJS^-n/i:i:#tcli. S^fl^^fiElHlKl 4 9 

I I jb^eois^iiHKffi^^, ^'77.*imssmmim& 
wsm^ 1 2 *^e<D^«sij««#<D 5 ^©7 f - -f tfx 

[0 0 7 5] ftfc, 7^'x^tfx-fOWSfi5i:LT(*s C 



<10) 



1$il2 002-2 2 342 0 



(0 0 7 61 COtctb. ipJSIalffil 4^Cfcl^T^i. Sffi 

tits ■?-n-Fn7<'x'f tfx-TissiiJawyaiLaii 4 

4i. 1 4 5i:lC^tl-?'n«tJ&?n«. 
[0 0 7 7] 7^X'f eT^-f jfimiilSEWyaJLaJI 4 4 

(OW^jtssnaj^ffl^icOL^T. 9\^^m^ i (b) *> 

J:t; (C) ^c^^tJ^ot^i. MIBS DiSfi!©;±eiiJR<DM 

(0 0 7 8] 7^'x-f ex-i'«msi«i:CT<fflyaiJn 
mwmmi. ^*ivnif'<±s y ^ u vs^ttajniB i 

4 6«5j:i;i 4 7tcet|gS-n. -^-tl^n. MIB7^x-f 
(0 0 7 91 as;fl^^fiKlsl»1 4 9tts iMSipJSIslK 

(00801 JJ<±(D*iJSlsl!8 1 4 «J J:t;atRl2l» 1 5 © 
1M^«. m 207P-9^-\'-h«#!>aLft!!j«6, J6 

ittwwrso c®iai 2<07a-f-f-h©iM^tt. tb 

(008 11 S#®iiijR<DS»ffl€»aiL (Xx 
•y^S 1 0 1 ) . S»^l(Dl6*MB3e«L*tMi«^:y**t^ 

is®ffl^«ai«?LTiii^-r« OsTvys 1 07) o 

(0 0 8 21 %(C. «3tBS5^0[>«e»fil««/Mri'«d. 

^-ex^-swaiL Ux«>ys 10 3, s 1 04) , » 

x-yys 10 6. S 1 08) „ dtllC^y. J:y7^x 
(0 0 8 31 7^7x-fex-f<D«i5i:LTfiv ± 



(0 0 8 41 $r-c. J.X±©iMtl?ffla<DS«B^tCfcLNTttx 
[0 0 8 51 Sfc. i)U:0<5iJT-»iv 

(0 0 8 61 *6tc. •>5;i»S®)S!ffla©KB^tcfclt 

^nifi^iioyaiLSsi 2 2fcj:t;s2iiJsEij]yaiLaj 

1 2 3T'©^^7;^4"y:^*J«J:lf^^j||^"y:/tt, -fiiJT'S 
fc, ±ai©ittWT'«. 5 X ^"y >^<!: ^aij^f -y foim 

(0 0 8 71 sfc. ismn^ammt. sosifiiA'e 

(00881 
[0Si©f9««§»B»l 

(la 1 1 z(mm^^^mmm^m<r)^wmi&<f>-it 

(BI21 C(D%W(Cj:%iSigi)lElSSIia)SI8SO)^tg7^T 

m 3 1 llfi5a)}^jS7fflt^ en^fii ©» ws^taso) 
(ISI41 m2<nmy<oms».&mkm<nmmM^vmt 

(SI 5 1 @ 3<D% 1 ©IRttSISmSUDSSIUiS^IKiiQ-r 

(Bel ii«5(D^iS7ffii'>6n««2(oieiaHS3»ii8is0!> 
(071 ^2mmmLm»X'(mmm<j>'itmzm^'' 

(IS 8] m2©«|fi!SS8»S©-69a}isl!S<DM««)J$/7 
(091 msaiWS!i<r)m^^WRt^t!.it><mZ'1b^. 
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[@i 0] m2<om»mmmo-9Tio^miRotA 

So 

[igii2] z.<o¥^miz^im»«imi&momm(OBmiz 
1 ^ ■■■■ammmmmm&mmms 1 2-<;3xim8 



n&fumiwmmK. 1 3- 

SJHIK. 1 5-SJRl2lKs 1 1 

1 2-wti^<7hium&> 1 

1 4-il«Sffijl!lS8|S. 1 2 2 
<^^7X^»yrwyiiJLa5) ^ 
LgP (^iiJ^'yTriaUliJLgU) 

1 25 Hi^HROM. 
4 1 •••SiJfil^ajSSS, 142 
-ItRipJSlHlKs 14 4. 14 
m^^VtiiL^. 14 6, 14 

1 4 8- lt<Sla]%. 1 



0-7\y-hyi^'J. 1 
1 3"tt«->7haJ. 1 

"SifiiSEiautiiLfiis 

1 2 3"«2liJSE«It;ili 
. 1 2 4— J'tZ^-K 
1 2 6Hft2E*aim 1 

-mmit^. 143 

4 9 - SIS^it^^JiSglK 
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